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FOREWORD 


The  inclusion  of  data  on  soldier  performance  in  models  of 
weapon  system  effectiveness  and  availability  is  expected  to  open 
new  avenues  for  manpower  considerations  to  directly  influence 
the  design  of  hardware  and  software  in  new  systems.  Methodolo¬ 
gies  for  evaluating  soldier  performance  data  are  already  under 
development  by  the  Army  Research  Institute  (ARI). 

This  research  grew  out  of  a  larger  effort  performed  for  the 
U.S.  Army  Operational  Test  Evaluation  Agency  (OTEA).  That  effort, 
in  support  of  the  Manpower  and  Personnel  Integration  (MANPRINT) 
portion  of  the  OTEA  program  entitled  Continuous  and  Comprehensive 
Evaluation  (C2E)  was  conducted  under  a  Memorandum  of  Agreement 
between  OTEA  and  the  ARI  signed  1  October  1984  and  19  October 
1984. 

During  the  conduct  of  the  larger  program,  it  became  ap¬ 
parent  that  an  important  question  concerning  the  use  of  the 
MANPRINT  analysis  methodology  would  be  whether  there  were  avail¬ 
able  any  essentially  nonintrusive  instruments  for  the  collection 
of  data  for  soldier  performance.  It  was  strongly  felt  by  spon¬ 
sors  at  OTEA  that  no  methodology  that  required  instrumentation 
that  compromised  the  "tactical  realism"  of  an  operational  test 
would  be  acceptable.  This  small  research  task  was  created  to 
identify  instrumentation  that  was  available  from  American  sources 
and  could  be  used  to  collect  soldier  performance  data. 

This  report,  which  is  essentially  a  catalog  of  available 
instruments  believed  to  be  suitable  for  use  during  operational 
tests,  should  be  read  with  the  report  of  the  major  project,  in 
which  the  concepts  of  soldier  performance  measurement  are  ex¬ 
plained.  Use  of  the  instrumentation  identified  in  this  report 
should  provide  a  cost-effective  means  for  obtaining  and  analyz¬ 
ing  data  during  manned  systems  tests. 
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MODERN  MANPRINT  INSTRUMENTATION 


1.0  INTRODUCTION 
1 . 1  Background 

A  program  entitled  "Continuous  Comprehensive  Evaluation  (C2E) "  has 
recently  been  initiated  by  the  United  States  Army  Operational  Test 
and  Evaluation  Agency,  under  the  direction  of  the  Vice  Chief  of 
Staff  of  the  Army  (VCSA) .  C2E  is  a  concept  which  approaches  data 
acquisition  in  a  manner  somewhat  different  from  traditional 
operational  testing.  System  tests  and  evaluations  conducted  under 
C2E  are  expected  to  be  of  longer  duration  and  more  comprehensive 
in  nature  and,  consequently,  should  embrace  a  wider  range  of  data 
sources.  One  data  source  as  dictated  by  the  newly  emerging 
requirements  of  the  MANPRINT  (Manpower  and  Personnel  Integration) 
effort,  will  involve  measurement  of  critical  soldier  performance 
and  reporting  of  that  performance  in  calculations  of  system 
effectiveness  and  availability  (para  2-12,  AR  602-2).  Models  and 
measures  for  MANPRINT  during  C2E  have  been  developed  which  explain 
how  to  process  and  interpret  soldier  performance  data  once  it  has 
been  collected  (Lowry  and  Seaver,  1986) . 

Although  MANPRINT  improvements  to  traditional  test  procedures 
promise  to  increase  the  accuracy  and  realism  of  resulting 
evaluations,  some  seasoned  testers  have  expressed  concern  that  the 
new  requirement  for  collection  of  soldier  performance  data  may 
somehow  compromise  the  tactical  nature  of  operational  testing.  If 
MANPRINT  in  C2E  is  to  succeed,  the  instrumentation  utilized  for 
capturing  critical  soldier  performance  must  be  as  unobtrusive  as 
possible,  while  remaining  fully  compatible  with  the  range  of  data 
collection  techniques  currently  employed  by  the  systems  analysis 
community. 

A  new  generation  of  electronic  instrumentation  (i.e.,  recording 
and  microprocessing  devices)  now  on  the  market  makes  it  possible 
simultaneously  to  sense,  record,  and  analyze  many  aspects  of 
soldier  performance  which  in  the  past  were  handled  either  by 
observers  with  clipboards  and  stopwatches  (inappropriate  to  most 
operational  testing  situations)  or  by  more  specialized, 
single-purpose  data  recording  and  processing  devices. 


1.2  Objective 

The  purpose  of  the  research  effort  reported  here  was  to  - 

a.  Acquire  technical  information  on  state-of-the-art  electronic 
data  collection  instrumentation  available  for  recording  time  and 
accuracy  dimensions  of  critical  soldier  performance  in  ways  that 
do  not  compromise  the  realism  requirements  of  operational  testing, 
and 


b.  Develop  preliminary  concepts  and  strategies  for  utilizing 
electronic  data  collection  instrumentation  for  recording  soldier 
performance  of  critical  tasks. 


1.3  Use 


This  report  is  intended  to  aid  government  and  contractor  personnel 
responsible  for  planning  and  conducting  MANPRINT  test  and 
evaluation.  This  report  specifically  addresses  the  identification 
and  availability  of  unobtrusive  instrumentation  appropriate  for 
obtaining  measures  of  performance  of  critical  operations  and 
maintenance  tasks  in  new  weapon  systems. 

2.0  INSTRUMENTATION  SPECIFICATION 

All  of  the  instrumentation  devices  described  in  this  report  are 
off-the-  shelf  items,  and  most  are  built  to  commercial 
specifications.  However,  with  appropriate  mounting,  all  should 
function  reliably  in  the  system  environments  where  measurement  of 
soldier  performance  is  required.  The  standard  operating 
environment  of  weapon  systems  maintained  and  operated  by  soldiers 
is  identified  in  paragraph  5.8  of  MIL-STD-1472 .  In  addition  to 
those  requirements,  some  of  the  instruments  have  also  been 
developed  for  more  specialized  military  applications  and, 
therefore,  also  adhere  to  other  military  specifications.  Such 
instruments  have  special  notations  in  the  appendices  to  this 
report . 

2 . 1  Instrumentation  Technical  Data 

The  technical  data  contained  in  those  appendices  were  obtained 
from  manufacturers  and  suppliers  in  responses  to  an  industry 
survey .  Neither  the  corporate  author  nor  the  Army  sponsor  of  this 
project  has  verified  these  dataT  No  recommendations  are  made  as 
to  the  selection  of  any  particular  brand  of  instrument,  and  no 
endorsement  of  any  instrument  or  manufacturer  should  be  inferred 
from  an  entry  in  this  report.  Potential  users  of  MANPRINT 
instrumentation  should  make  their  selections  from  the  appendices 
to  this  report  based  on  the  ability  of  the  instrument  to  fulfill 
specific  measurement  needs  in  teirms  of  technical  capability, 
availability,  cost  and  supporting  services. 

2 . 2  Instrumentation  Appendices 

This  report  includes  four  separate  appendices,  each  for  a 
different  type  of  instrumentation.  Appendices  are  provided  for 
miniaturized  video  cameras,  video  recorders,  remote  control  and 
mounting  devices,  and  databus  recorders.  When  this  report  was 
written,  each  instrument  listed  in  the  appendices  was  available 
and  represented  current  state-of-the-art  in  terms  of  size, 
capability,  and  competitive  cost  of  the  technology  represented. 
Unusual  aspects  of  the  listed  instruments  are  specifically  noted 
in  the  appendices. 


2.3  Technical  Assistance 


Many  of  the  manufacturers  and  suppliers  provide  technical 
assistance  in  the  use  of  these  instruments.  Therefore,  each 
appendix  includes  the  name  a  vendor,  address,  point  of  contact, 
and  telephone  number  for  each  listed  instrument.  Test  planners 
may  wish  to  use  these  complimentary  services. 


2.4  Scope  of  Instrumentation 

The  instruments  listed  in  this  report  are  relatively  low  cost/high 
tech  items  selected  to  meet  specific  performance  monitoring  needs. 
Requirements  for  more  sophisticated  instrumentation,  such  as  the 
Army's  MILES  systems  and  test  ranges  used  at  the  National  Training 
Center,  are  not  addressed  in  this  report. 

The  instruments  listed  in  appendices  1  through  4  were  also 
selected  for  their  compliance  with  the  criterion  of 
"unobtrusiveness.  •'  However,  the  user  needs  to  exercise  independent 
judgment  in  matching  instrumentation  to  the  specifics  of  the 
soldier-machine  system  to  be  tested:  an  18-inch  long  video  camera 
might  be  unobtrusive  when  mounted  on  a  pole  in  a  darkened  corner 
of  a  command  post  tent;  the  same  camera,  mounted  inside  an  armored 
personnel  carrier,  is  not  unobtrusive. 


3.0  TEST  SITUATIONS 

The  instrumentation  listed  in  this  report  is  structured  around 
four  hypothetical  test  "situations,"  each  representing  a 
progressively  more  difficult  challenge  to  the  instrumentation 
planner.  The  four  are: 

Situation  1  -  Stationary  vehicle  or  tactical  operations 
center  (TOC)  with  one  operator  being  monitored. 

Situation  2  -  Stationary  vehicle  or  TOC  with  three  or  four 
operators  being  monitored  simultaneously. 

Situation  3  -  Moving  vehicle  or  mobile  TOC  with  one 

operator  being  monitored. 

Situation  4  -  Moving  vehicle  or  mobile  TOC  with  three  to 
four  operators  being  monitored  simultaneously. 


4.0  SELECTION  OF  INSTRUMENTATION 

This  section  of  the  report  explains  how  to  make  selections  from 
the  four  instrumentation  appendices  given  (1)  the  general 
situation  (paragraph  3.0  above)  and  (2)  the  specific  requirements 
of  the  soldier-materiel  system  to  be  tested.  The  guidance  below 


1 


is  intended  to  lead  to  the  selection  of  the  lowest-priced 
instrumentation  appropriate  to  test  data  requirements.*  The  user 
should  also  consider  the  size  of  the  instrumentation  package  when 
making  a  selection. 

4.1  Situation  1. 

The  following  basic  guidelines  are  provided  when  using  Appendices 
1  through  4  to  meet  the  requirements  of  Situation  1  (monitoring  a 
single  individual  in  a  stationary  structure  or  sedentary 
position) . 

A.  For  tests  in  daylight,  where  the  test  subject  does  not 
require  cues  from  color  perception  in  order  to  perform  his 
critical  tasks  correctly  - 

1.  Select  a  black-and-white  video  camera  from  Appendix 
1.  Make  the  selection  based  on  appropriate  power,  size,  weight, 
and  anticipated  ambient  light. 

2 .  Select  a  video  recorder  from  Appendix  2  based  on 
appropriate  power,  size,  weight,  recording  time,  tape  format  and 
compatibility  with  camera  selected. 

3 .  Where  the  tasks  to  be  monitored  may  be  performed  in 
an  area  larger  than  a  single  console,  selection  of  a  wide-angle 
lens  is  recommended.  An  alternative  is  a  multiple  camera  setup 
with  a  remote  control  unit  (from  Appendix  3)  to  activate  different 
cameras  on  a  set  schedule,  or  a  movement  detection  device  to 
activate  each  camera  when  a  test  participant  moves  into  its  range. 

B.  For  tests  in  daylight  where  the  test  soldier  requires 
cues  from  color  perception  in  order  to  perform  critical  tasks 
correctly  - 

1.  Select  color  video  camera  from  Appendix  1. 

2.  Follow  steps  2  and  3  as  stated  above. 

Where  available  space  is  particularly  scant  (as  in  the  cockpit  of 
an  aircraft)  a  miniaturized  camera  of  the  sort  shown  in  Figure  1 
is  recommended. 

C.  For  tests  in  very  low  light  levels  - 

1.  Select  a  "night  vision"  observation  device  from 
Appendix  1.  Make  the  selection  based  on  appropriate  power,  size. 


*The  user  is  reminded  that  there  is  often  an  additional  trade-off 
between  cost  and  reliability.  That  issue  is  not  addressed  in  this 
report. 


weight,  and  anticipated  fluctuations  in  ambient  light  of  .0075  fc 
or  less. 

2.  Select  a  compatible  video  recorder. 

3 .  Where  circumstances  make  video  recording 
impractical,  consider  using  a  databus  (Appendix  4).  The  latest 
developments  in  databus  recording  make  it  possible,  for  relatively 
low  cost,  to  read  selective  data  from  the  1553  databus  for 
accurate  measurement  of  task  performance  in  both  time  and  error 
parameters . 


4.2  Situation  2 

The  following  guidelines  are  provided  for  using  Appendices  1 
through  4  to  meet  the  requirements  of  Situation  2  (three  or  four 
individuals  in  a  stationary  location) .  The  guidelines  for 
Situation  2  are  the  same  as  for  Situation  1  with  these  exceptions: 

A.  For  tests  in  daylight,  select  a  video  recorder  that 
will  record  synchronized  multi-channels.  Visible  action  of  three 
or  four  individuals  can  be  recorded  and  displayed  with 
synchronized  split  screen  for  post  performance  evaluation. 

B.  For  tests  in  low  light  level  situations,  primary 
consideration  should  be  given  to  use  of  a  databus:  the  ease  and 
accuracy  of  its  use  in  multiple-player  situations  generally 
outweighs  its  cost. 

Figure  2  shows  how  MANPRINT  testers  can  simultaneously  monitor  the 
performance  of  multiple  soldiers  performing  critical  tasks  on  and 
around  stationary  platforms. 


4.3  Situation  3 

This  situation  is  analogous  to  Situation  1,  except  that  the 
platform  on  which  the  soldier  performance  of  interest  is  taking 
place  is  moving.  Such  movement  introduces  four  instrumentation 
concerns: 

A.  Mounting  of  instruments.  When  testing  in  a  moving 
environment,  instruments  should  be  mounted  in  the  same  plane  as 
the  moving  platform  to  limit  the  effects  of  vibration  on  the 
quality  of  video  recording.  This  is  not  a  problem  with  databus 
recording.  Use  Appendix  3  to  select  appropriate  mounting. 

B.  Remote  Control.  Hard-wired  remote  control  cannot  be 
used  on  a  moving  platform.  Care  must  be  taken  in  selecting  radio 
remote  control  so  that  signals  do  not  interfere  with  tactical  data 
transmission  or  data  collection. 

C.  Data  Recording  Location.  Where  the  soldier  performance 
of  interest  is  on  a  moving  platform,  the  test  planner  must  decide 
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Figure 2  Illustration  of  Monitoring  Three  Or  More  Soldiers  In  A  Stationary  Location 


whether  to  add  to  the  platform  (on  which  space  is  normally  at  a 
premium)  a  data  recording  device  or  to  transmit  the  data  from 
sensors  on  the  platfonn  to  a  fixed  recording  station.  Advances  in 
electronics  now  make  both  alternatives  feasible,  although  tactical 
maneuvers  (as  occur  in  many  operational  tests)  are  normally 
accompanied  by  a  high  volume  of  radio  signals  any  of  which  could 
conflict  with  data  telemetry.  Moreover,  DoD  and  Army  T&E  leaders 
have  often  expressed  the  desire  to  conduct  at  least  some  tests 
under  electronic  warfare  (EW)  conditions.  These  circumstances 
often  tend  to  bias  the  choice  toward  on-platform  data  recording 
using  devices  such  as  the  one  shown  in  Figure  3.  Appendix  2  lists 
several  small  video  recorders  suitable  for  on-platform  mounting, 
although  some  ruggedization  (such  as  viscous  damping)  may  be 
necessary  if  the  platform  is  going  to  experience  severe  shocks  and 
high  moments  of  force. 

D.  Power  Supply.  A  free-moving  platform  requires  that 
instrumentation  aboard  have  its  own  power  source  or  be  wired  into 
the  power  organic  to  the  platform.  Appendix  1  shows  both  AC  and 
DC  voltages  for  video  cameras,  and  Appendix  2  presents  the  same 
information  for  recorders. 


4.4  Situation  4 

This  situation  is  analogous  to  Situation  2,  except  that  there  are 
multiple  operators  and,  often,  multiple  moving  platforms  on  which 
the  soldier  performance  of  interest  is  occurring.  The  same 
instrumentation  concerns  discussed  in  para  4.3  (above)  apply  here 
as  well;  but  in  this  situation  there  is  the  additional 
complication  of  the  need  for  multiple  simultaneous  performance 
records.  Especially  when  the  performance  analysis  of  the  system 
(or  force)  depends  upon  knowing  the  sequence  in  which  events 
happened,  it  is  necessary  to  link  together  many  (or  all)  of  the 
data  sensors  on  a  common  time-line.  A  databus  normally  includes  a 
"real-  time"  record,  and  many  multi-channel  recorders  have  it  as 
an  option. 

Figure  4  illustrates  the  use  of  multiple  sensors  over  a  single 
piece  of  terrain  on  which  soldiers  in  multiple  vehicles  are 
maneuvering,  where  all  sensors  are  controlled  from  a  single  point 
on  the  terrain. 
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APPENDIX  3 

MANPRINT  SURVEY  OF  PAN  AND  TILT 
CONTROL  UNITS 
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